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ABSTRACT,  For  the  most  part,  error  analysis  has  been 
treated  as  though  only  independent  errors  are  involved. 

For  convenience  and  simplicity,  this  has  been  a  valid 
assumption  in  error  analysis  at  ACIC,  However,  with 
the  necessity  for  analyzing  and  reducing  massive  data 
an  awareness  of  the  existence  of  dependent  errors  and 
their  significance  in  error  analysis  becomes  increasingly 
necessary. 

The  analysis  of  dependent  errors  makes  use  of  the 
concept  of  distribution  moments  and  the  moment  matrix 
(covariance  matrix).  This  paper  presents  an  an6l.ysis 
of  the  normal  bivariate  and  trivariate  error  distributions 
along  with  their  relationships  to  the  moment  matrix,  and 
the  application  of  this  concept  to  least  squares  and 
adjustments.  It  is  shown  that  a  suitable  transformation 
of  the  covariance  matrix  yields  independent  errors  which 
may  be  substituted  for  the  dependent  errors  in  further 
error  analysis.  A  brief  introduction  to  matrix  properties 
is  also  included  for  background  information. 
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1.  INTRODUCTION 


1.1.  Purpose.  The  occurrence  of  data  Involving  several  variables 
is  quite  common  to  the  reduction  of  geodetic  information  to  a  useful 
form.  Reduction  of  such  information  requires  certain  generalizations 
euod,  for  simplicity,  it  is  often  assumed  that  the  variables  are  com¬ 
pletely  independent  of  each  other.  In  many  instances,  this  is  not  a 
valid  assumption  and  some  type  of  reduction  which  considers  the  inter¬ 
relationship  between  variables  is  necessary. 

The  following  sections  describe  a  method  of  reduction  which  will 
reflect  the  correlation  between  the  variables.  Extensive  use  is  made 
of  statistical,  geometrical,  and  matrix  properties. 

1.2.  Assumptions  and  Generalizations.  The  mean  value  (x)  of  a 
random  variable  is  comxnited  by: 


where: 

X  *» 
X  « 

n 

i-1 


n 


mean  value 
a  random  variable 

sign  indicating  the  sum  of  all  values  (x^,  Xg,  x^) 


n  »  number  of  measurements. 

As  n  grows  larger  the  value  of  x  becomes  more  reliable.  In 
theoretical  statistics,  n  is  considered  to  approach  infinity  and 


therefore,  incorporates  a  universe  of  readings.  When  n  approaches 
00  ,  the  computed  value  approaches  the  theoretical  value.  The 
theoretical  value  for  the  mean  is  generally  considered  the  expected 
value  and  symbolized  by  Ejx|. 

Another  statistical  parameter,  the  standard  error  (a),  denotes  the 
dispersion  of  the  measiired  values  around  the  mean  and  is  computed  by: 


The  square  of  the  standard  error  (a)  is  loiown  as  the  variance . 

Since  X  and  n  also  enter  the  computation  of  the  standard  error,  it 
Is  again  assumed  that  the  true  standard  error  is  obtained  vfith  n  ap¬ 
proaching  00  .  l/hile  the  distribution  of  x  is  discrete  no  devastating 
error  results  when  the  discrete  function  is  considered  continuous  with 
n  ranging  from  -  oo  to  +  oo  .  It  is  also  assumed  that  the  variables 
are  normally  distributed  with  systematic  errors  eliminated. 

1.3.  Independent  and  Dependent  Errors.  In  error  terminology  two 
types  of  errors  are  considered  —  dependent  and  independent.  The 
treatment  of  Independent  errors  is  comparatively  simple  because,  as  the 
name  liiQ)lles,they  are  independent  of  each  other.  For  example,  the 
magnitude  of  of  one  variable  is  completely  independent  of  the  magni¬ 
tude  of  the  error  of  another  variable.  Dependent  errors  (e^,  e^), 
however,  are  more  Involved  as  the  magnitude  and  even  the  occurrence 
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of  depends  on  the  meignitude  or  occurrence  of  e^. 

Correlation  deals  with  the  interrelationship  of  dependent  errors. 

The  degree  of  correlation  is  expressed  hy  a  nvonerical  quantity  called 
the  correlation  coefficient  (p).  Although  independent  errors  are 
uncorrelated  the  converse  is  not  necessarily  true.  It  does  not  follow 
that  two  errors  are  independent  solely  "because  their  correlation 
coefficient  is  zero.  Consider  the  distribution  which  has  a  frequency 
function  expressed  as  x^  +  y^  »  R^.  Since  this  is  a  circle  pos¬ 
sessing  symmetry,  the  mean  values  and  p  would  be  considered  zero  and 
uncorrelated.  However,  to  be  Independent  it  is  necessary  that  f(x,y) 
be  of  the  form  f(x)  f(y). 

2.  MATRIX  PROPERTIES 

The  matrix  method  lends  itself  to  problems  involving  numerous 
variables  ajid  mathematical  manipulations.  It  provides  a  system  of 
compact  expressions  for  series  of  equations  and  permits  performance 
of  mathematical  processes  with  a  minimum  of  work.  Some  of  the  basic 
properties  of  the  matrix  method  are  presented  at  this  point  to  insure 
uniform  \inder standing. 

2.1.  Definitions  and  Notations.  An  aggregate  of  numbers  ai'ranged 
in  a  rectangular  array  is  called  a  rectangular  matrix,  or  simply,  a 

The  theory  of  indejwndent  errors,  their  probabilities  and  propagational 
methods  for  univariate,  biveu:iate,  and  trivarlate  cases  is  developed 
in  TR-96  "Principles  of  Error  Theory  and  Cartographic  Applications." 
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matrix.  The  array  has  m  rows  and  n  coliunns  and  is  denoted  hy: 


^11 

Eig  •  •  . 

a. 

In 

agi 

^22  *  *  * 

•  •  • 

So 

2n 

^•ml 

V  ••• 

®mn 

the  first  subscript  designates  the  row,  the  second  the  column  in  which 
the  element  is  located.  If  the  dimensions,  m  x  n  (m  by  n),  of  A  are 
borne  in  mind,  it  suffices  to  use  the  brief  notation: 

A  *»  **  1,  2,  ...,  m;  j  —  1,  2,  ...,  n). 

Two  matrices  are  equal  if  their  corresponding  elements  are  equal. 
Matrices  conqposed  of  a  single  row  are  called  row  matrices  and  those 
composed  of  a  single  column  coltimn  matrices.  In  a  square  matrix  of 
the  n^^  order,  the  number  of  rows  equals  the  number  of  columns. 

Among  square  matrices,  an  important  role  is  played  by  diagonal 
matrices,  i.e.,  a  matrix  in  which  only  the  elements  of  the  principal 
(leading)  diagonal  are  different  from  zero; 

0  ...  0 

0  Og  . . .  0 

•  •  • 

0  0  , . .  ctjj 
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If  a.31  the  numhers  of  such  a  matrix  are  equal  to  each  other,  the 
matrix  is  said  to  be  a  scalar; 


a  0  ...  0 
0  a  ...  0 

•  •  • 

0  0  ...  a 

and,  if  a  "  1,  the  matrix  is  said  to  be  the  unit  matrix  I; 


1  0  ...  0 

0  1  ...  0 


^  0  . . .  Ij 


A  matrix  with  elements  equal  to  zero  is  a  null  or  zero  matrix  and 
is  designated  by  the  symbol  0. 

The  detezmlnant  of  a  matrix  is  associated  with  any  square  matrix. 
The  determinant  of  the  square  matrix  P  is  designated  IP|  and  its 
elements  are  the  elements  of  matrix  P  without  disarrangement.  If 
IP  I  y  0,  then  P  is  called  a  non- singular  matrix. 

When  the  rows  and  columns  in  matrix  A  are  Interchanged: 


^11 

^12 

®ln 

®’21 

agg  ... 

•  •  • 

®2n 

\l 

a 

mn 

[aijl. 
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the  transposed  matrix  or  transpose: 


^-ll 

agi  ... 

^ml 

^22  *  *  * 

•  •  • 

®’m2 

^in 

•  •  • 

2n 

®tan 

is  obtained. 

2.2.  Elementeory  Operations  on  Matrices.  To  effectively  use 
matrices,  the  methods  of  addition  and  multiplication  must  be  defined. 
When  the  elements  of  a  matrix  are  obtained  by  multiplying  all  the 
elements  of  the  matrix  A  by  a  number  a,  the  result  is  called  the 
product  of  a  and  the  matrix  A. 


aaii 

•  •  • 

«^ln 

oagi 

•  •  • 

“^2n 

««ml 

•  *  • 

««mn 

For  example  let: 


a  «  3,  and  A 


3^1 
262 
10  1 


then: 


'3-3 

3-*^ 

3-1 

"9 

12 

3' 

ok  » 

3-2 

3-6 

3-2 

8 

6 

18 

6 

3-1 

3*0 

3-1 

3 

0 

3 
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When  the  elements  of  a  matrix  C  are  the  stans  of  the  correspoziding 
elements  of  A  and  B,  the  result  is  the  sum  of  A  and  B  and  is  defined 
only  when  A  and  B  have  the  seme  dimensions. 


®11 

+  b^^ 

^12  ^12  *  *  * 

V 

C  -  A  +  B  - 

®2‘l 

+  ^21 

822+^22  •  *  * 

s  •  s 

^2n 

■^^2n 

®’ml 

■"^ml 

®m2  ^m2  *  *  * 

^inn 

+  b 
mn 

For  exaa^le,  let: 


2  0  0  4 

1  596" 

A  ■ 

and  B  » 

6321 

• 

3-478 

Then: 


A  +  B  -  C  - 


2  +  1  0  +  5 

6+3  3  +  (-^) 


0  +  9  ^  +  6 

2+7  1+8 


3  5  9  10 

.9-19  9 


2.2.1.  Basic  Properties  of  Matrix  Addition  and  Multiplication. 

A  +  (B  +  C)  »  (A  +  B)  +  C 
A  +  B  *»  B  +  A 
A  +  0  «  A 
(a  +  P)  A  «  oA  +  pA 
a  (A  +  B)  e  OA  +  0© 
vhere  a  and  p  are  numbers. 

2.2.2.  Multiplication  of  Matrices.  Multiplication  of  the 
matrices  A  and  B  is  defined  if,  and  only  if,  the  number  of  columns 
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of  matrix  A  equals  the  number  of  rovs  of  matrix  B.  The  elements  of 
the  product,  C  *»  AB,  are  defined  in  the  follo\d.ng  manner:  the 
element  in  the  i^  row  and  column  of  C  is  equal  to  the  svim  of 
the  products  of  the  elements  of  the  i^^  row  of  matrix  A  by  the 
corresponding  elements  of  the  column  of  matrix  B.  Thus: 


Note  that  the  product  of  two  rectangular  matrices  is  again  a 
rectangular  matrix,  where  the  number  of  rows  is  equal  to  the  number 
of  rovs  in  the  first  matrix,  and  the  number  of  columns  equals  the 
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xnm'ber  of  coluoms  in  the  secood.  For  exariple,  let: 


5  2* 

2  3^ 

B  ■■ 

6  3 

5  2  1 

_2  1 

Then: 


AB  -  C 


2*5  +  3*6  +  1^*2,  2*2  +  3*3  + 

5*5  +  2*6  +  1*2,  5*2  +  2*3  +  1*1 


36  17 

39  17_ 

Another  property  Of  matrix  multiplication  Is: 

.T 


{A*B) 


T  T 
B»  A 


or^  the  transpose  of  the  product  of  two  matrices  Is  equal  to  the 
product  of  the  transpose  of  each  matrix  In  reverse  order.  (This 
property  may  he  generalized  to  products  Involving  more  than  two 
matrices.)  For  exanqtle,  let: 


'3 

0  2 

A  ■ 

and  B  « 

_1  5, 

>  3 

then: 


16 

is' 

T 

16 

20 

AB  - 

20 

17_ 

and  (AB)  «■ 

Ifl 

17_ 

9 


Then; 


l6  20 
18  17 

2.3-  Inversion  of  a  Matrix.  The  Inverse  a"^,  or  the  reciprocal 
of  a  real  number,  Is  defined  If  a  /  0.  There  Is  an  analogous 
operation  for  square  matrices.  If  A  Is  a  non-singular  square  matrix, 
then  a  unique  matrix  written  (A"^)  exists  with  the  Important  property: 

AA"^  =  I 
or; 

A"^A  a  I 

where  I  is  the  unit  matrix.  If  it  exists,  the  matrix  A“^  is  called 
the  inverse  matrix  of  A  and  expressed  by; 


where ; 


lAI 


or  equivalently 


That  is,  the  bj^j  element  (the  element  in  the  1^^  row  and  column 
of  the  Inverse  matrix)  Is  found  by  1®^  tremsposlng  the  matrix  A;  then 
deteiminlng  the  cofactor  (a*^^)  of  each  element  in  the  transpose;  and 
dividing  each  cofactor  by  the  determinant  of  matrix  A.  The  cofactor 
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Is  the  signed  minor  determlnstnt  obtained  by  deleting  all  the  elements 
In  the  sane  rov  and  colvimn  as  the  element  whose  cofactor  Is  desired; 
if  the  sum  of  1  +  J  (row  number  +  column  nvuuber)  is  even,  the  minor 
determinemt  is  multiplied  by  a  positive  one  (+l);  if  i  +  J  is  odd 
the  minor  determinant  is  multiplied  by  negative  one  (-l).  For  example, 
let: 


3  ^ 

II 

P 

II 

*3  2‘ 

_2  1 

IJ 

4  1 

lAl  =  3  -  8  =  -5 


a^l  = 

(+1) 

(1) 

as  1 

al2  . 

(-1) 

(M 

=  -4 

21 

a  = 

(-1) 

(2) 

=  -2 

a22  = 

(+1) 

(3) 

=  3 

12 

where  a  =  a*^  ,  the  cofactor  of 

the 

element  in  the  1®^ 

row  and  2^*^ 

T 

column  of  A  .  Since  i  +  J  = 

1  + 

2  = 

3  multiply  minor 

determinant 

by  (-1). 
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Hence ; 


The  result  can  "be  checked  by  forming  the  product: 


3(-f)  +  H|)  3(^)  +  M-f) 

2(-  5)  1(f)  4f)  +  K-  f) 


Since  A*A“^  »  I,  the  inverse  A"^  is  correct. 

The  above  scheme  is  impractical  for  matrices  of  order  greater  than 
two.  Consequently,  other  schemes  for  the  computation  of  inverses  have 
been  devised.  For  a  3rd  order  square  matrix,  the  procedure  is  as 
follows ; 


12 


let; 


then: 


where : 


A 


^11 

^12 

®13 

®21 

®22 

®23 

®31 

^32 

®33 

1  m 

n 

r  s 

t 

U  V 

w 

1  „  -  ag3a3g 

lAl 

ai^a^g  “ 

SI  ® 

lAl 

n  «  - - ■' - 

lAl 

j.  „  ag^a^i  - 

lAI 

|A| 

^  "  ^13.°g3 

lAI 

u  „  °2l‘^32  ~  ^22^31 

lAl 
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V  » 


^12^31  ~  °'ll°'3g 


lAI 

®11®22  ■  ®12®21 
V  a  - 

lAl 


2.4.  Differentiation  of  Matrices.  Let  A(x)  "be  a  matrix  depending 


on  a  numerical  variable 

x  so  that  the  elements  of  A(x) 

are 

functions  of  x.  That  is 

• 

* 

e^(x) 

a^(x)  . . . 

A(x)  = 

^22^^^  *•* 

•  •  • 

a  (x) 
mn 

The  derivative  of  A(x)  is: 

da^(x) 

‘’“in' 

xf 

dx 

dx 

dx 

daggCx) 

^“2n< 

x) 

dA(x)  _ 

dx 

dx 

dx 

dx 

«  • 

• 

da^(x) 

da  ( 
mn' 

x) 

dx 

dx 

dx 

l4 


For  exantple  let: 


A(x) 


3x" 

X 


2x^ 


5x" 


then: 


dx 


6x  6x 
1  2x 


4x“ 


20x" 


Partial  derivatives  are  obtained  similarly.  Suppose  that: 


3  2  5 

s^i  +  2x2  +  5x2 

A*X  ■ 

2  4  1 

^2 

■ 

2Xi  +  4xg  +  x^ 

4  2  2 

"3 

4x^  +  2Xg  +  2x^ 

then: 


3  +  0+0 

2+0+0 

0+2+0 

0  +  4  +  0 

_4  +  0  +  0_ 

2 

0+2+0 

and 

0+0  +  5 
0  +  0  +  1 
0  +  0  +  2 

It  can  he  seen  that  partial  differentiation  of  the  rows  of  A*X 


3 


with 
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respect  to  each  yields  the  1^^  column  of  matrix  A. 
2.5.  Quadratic  Forms.  A  polynomial: 

f  a  f(x,y)  «  +  6xy  +  Qy^, 


with  real  coefficients  and  every  term  of  degree  two  in  x  and  y,  is  a 
quadratic  form  in  x  and  y.  Quadratic  forms  play  a  prominent  role  in 
analytical  geometry  and  statistics.  To  relate  them  to  matrices,  the 
polynomial  is  written: 

f  =1  5x^  +  3xy  +  3xy  +  8y^ 


x(5x  +  3y)  +  y(3x  +  8y) 
5x  +  3y 

3x  +  8y 


[x,y] 


“  [x,y] 


- 1 

[3  8_ 

_ 1 

Thus  the  matrix 

r 

5  3 

may  he  used  in  expressing  the  quadratic  form  f: 


T 

X  AX 


where : 


X 


column  matrix 


X 


1 


1. 


The  column  matrix  X  can  also  he  written 
a  more  desirable  form. 


L^'J 

T 

[x  y]  which  is  sometimes 
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3.  MOMENTS  OF  A  DISTRIBUTION 


The  concept  of  moments  is  utilized  for  a  Geometrical  interpreta¬ 
tion  of  the  pcorameters  of  an  error  distribution.  The  first  moment 
of  mass  is  the  product  of  the  mass  and  the  moment  arm.  The  first 
moment,  when  divided  by  the  mass,  is  defined  as  the  center  of  mass. 
The  second  moment,  moment  of  inertia,  is  defined  as  the  sxim  of  the 
products  obtained  by  multiplying  each  elementary  mass  by  the  square 
of  its  distance  from  the  line.  The  second  moment,  when  divided  by 
the  mass,  is  defined  as  the  square  of  the  radius  of  gyration.  Con- 
siderinG  a  distribution  representing  a  hypothetical  unit  mass,  the 
moments  of  the  hypothetical  mass  correspond  to  the  statistical  para¬ 
meters  of  the  distribution. 

Consider  the  distribution  of  missile  impacts  around  an  aiming 
point,  the  performance  minus  computed  values  (impact  minus  aiming 
point)  are  expressed  as  doimrange  and  crossrange  errors,  fig.  1. 


y  crossrange  error 
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The  relationships  between  statistical  parameters  and  moments  are  used 
to  derive  the  distribution  function  [f(x,y)]  which  describes  the 
frequency  distribution  of  the  errors.  The  errors  are  assumed  to 
follow  a  normal  distribution. 

The  analysis  of  a  distribution  by  its  moments,  in  the  pure  mathe¬ 
matical  sense, is  complicated.  For  convenience  it  is  assumed  that  the 
moments,  as  found  by  succeeding  sections,  describe  a  unique  distri¬ 
bution.  ^ 

3.1.  First  Moment.  The  first  moment  corresponds  to  the  mean 
value  of  a  distribution.  The  mean  values  (x,y)  of  the  crossrange  and 
downrange  errors  are  computed  by: 


n 

n 

z  ^i 

1=1 

i=l 

n  ’ 

y  - 

^  n 

where : 

X  =  crossrange  error 
y  =  downrange  error 

The  correspondence  between  the  mean  value  and  first  moment  is  appar¬ 
ent  from  the  definition  of  the  first  moment  and  can  be  visualized  by 
considering  small  masses  (dm  =  l)  with  coordinates  along  an  assumed 
straight  bar  (whose  weight  is  neglected).  The  first  moment  or 


1. 


A  thorough  discussion  concerning  moments  and  uniquiness  of  distri¬ 
butions  is  contained  in  references  Nr.  4  and  12. 
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center  of  mass  of  the  system  of  particles  Is: 


All  masses  dm  are  considered  equal  to  1. 

The  values  x  and  y  are  the  centers  of  the  tvo  distributions  f(x) 
and  f(y),  the  point  (x,y)  is  then  the  center  of  the  combined  distri¬ 
bution  f(x,y).  For  convenience  of  notation  and  computation  the 
coordinate  system  is  considered  as  having  its  origin  at  (x,y). 

In  the  theoretical  approach,  the  meeua  value  is  the  expected  value. 
Since  all  possible  values  must  be  considered,  the  theoretical  first 


moments  are: 


and: 


as  n  — • 


y-^Py  as  n— • 
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3.2.  Second  Moment .  The  second  moment,  the  moment  of  inertia, 


corresponds  to  the  variance  of  a  distribution.  The  second  moment  of 
an  object  describes  a  physical  characteristic  of  the  mass,  the  manner 
of  which  the  mass  is  distributed  within  the  body;  the  variance  denotes 
the  similar  characteristic  within  a  distribution.  The  second  moment, 
about  the  coordinate  axis,  of  the  system  of  particles  Introduced 
in  section  3*1*  is: 


E 


i=l 


p 

x^dm 


thus  the  theoretical  second  moment  isi 


I 


2 

xcm 


The  variance  by  definition  is  the  mean  of  the  squares  of  all  the  errors 
and  computed  by: 


n 


4 


i=l 


n 


where  x  is  the  error. 

Written  in  theoretical  sense; 


P 


f(x)dx 


cr^  = 


I  f(x)dx 
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since : 


f(x)dx  =  1 


-+w 


x'^f(x)dx 


‘XX 


similarly; 


/' 


•faa 

.2 


f(y)dy 


‘yy 


A  standard  error  ellipse  can  now  be  drawn  with  its  center  at  the 
origin  and  and  as  its  semimajor  and  semiminor  axes.  The 
ellipse  displays  the  concentration  of  the  distribution  of  downrange 
and  crossrange  errors  in  the  x  and  y  directions. 

3.3-  Mixed  Product  Moment.  The  covariance  is  the  mixed  product 
moment.  Although  first  and  second  moments  of  x  and  y  were  described 
earlier,  when  the  moments  of  two  or  more  veu*iables  are  considered,  a 
third  type,  the  mixed  product  moment  (covariance),  exists.  By  defi¬ 
nition  the  covariance  is; 


xy 


y)dxdy  =  E)x,y( 


where;  integration  takes  place  over  the  entire  area  of  the  distri¬ 
bution. 

3.4.  Moment  Generating  Function.  The  moment  generating  function 
is  introduced  to  avoid  difficult  integration  which  is  encountered  in 


21 


moment  (variance-covariance)  functions.  The  moment  generating  function 
for  the  univariate  case  (single  variable)  is  defined  as: 


„/  8x|  0x, 

E<e  >  =  el 

j-to 


e®^f(x)dx 


where:  0  is  a  mathematical  device  introduced  for  the  purpose  of  defin¬ 
ing  the  moments. 


0^ 

Developing  e  in  power  series: 

0x 


e  =  1  +  0x  + 


2.'  3.' 


Integrating  the  power  series: 


E|e®*|  »  /  f(x)dx  +  /  0xf(x)dx  +  /  f(x)dx  +  /  ^ 

J-ta  -/-aa  -'-CD  -/-aa 


f(x)dx  +  .. . 


/  f(x)dx  +  0  /  xf(x)dx  +  ~  /  x^f(x)dx  +  ^  /  x3f(x)dx  +  ... 


’“i. 


x^f(x)dx  +  ... 


From  previous  definitions; 

r**  r**  rT 

I  f(x)dx  »  1;  /  xf(x)dx  =  /  x‘^f(x 

J -ta  "• 


)dx  =  n 


XX 


and: 


/  x^f(x 


)dx  5  moment  of  x 
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Therefore : 


l  +  ... 

The  successive  derivatives  of  E|e®*^vith  respect  to  0»  evaluated  at 
6*0  yields  the  corresponding  moments. 

Since : 


Therefore  the  moment  k  of  the  distribution  function  may  be  obtained 
by  the  derivative  of  the  function.  This  property  will  be  applied 
later. 

3.?.  Moment  Matrix.  The  moment  matrix  (M)  contains  the  parameters 
of  the  distribution  and  is  used  as  a  convenient  notation  describing  the 
distribution  function. 


M 


XX 

^xy 

yx 

•^yy 

where ; 

"  variance  in  x(c2) 

2 

Hyy  ■  variance  In  y(Oy) 

fijjy  «s  =  covariance  of  x  and  y 
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p 

p 


let  a. 


xy 


— ■—  (assumed  value) 
correlation  coefficient 
(A, 


P®x®y 


xy 


and: 


-  1<  p  ^  +  1 

M  will  always  be  a  symmetric  matrix. 

The  reoik  (r)  of  M  displays  the  properties  of  a  distribution. 
When: 


r*»0;p  =p  “0  the  mass  is  concentrated  at  a  point,  the 

JDC  yy 

center  of  mass. 

r  “  1:  u  •  u  “0  the  mass  is  concentrated  on  a  straight 

line  passing  throu^  the  center  of  mass, 
r  >  1;  there  is  no  straight  line  which  contains  the  total  mass 
of  the  distribution. 


4.  APPLICATION  OF  MOIENTS  TO  THE  NORMAL  ERROR  DISTRIBUTION 


The  normal  error  distribution  is  written  in  the  form: 


where : 


f  =  Kg  exp 


2 


Qg  is  the  quadratic  expression  of  the  error  distribution, 
is  the  constant  corresponding  to  a  particular  Qg. 


To  be  proven  later. 

For  notation  purposes  the  exponential  values  (e^)  will  be  written 
exp^x^. 
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The  general  normal  bivariate  error  distribution  form,  expressed  by 
its  statistical  parameters,  is  obtained  by  use  of  the  moment  gener¬ 
ating  function  and  moment  matrix. 

^.1.  Determination  of  Constant  for  the  Normal  Bivariate  Error 
Distribution.  The  quadratic  expression  for  the  bivariate  error 
distribution  is  written: 

Qg  =  a^^X^  +  2a^Xy  +  a^^Y^ 

Then,  from  section  2.4.: 


[X,y]  a^j^  a^ 

^12  ®22 

where : 

X  =  (x  -  x) 

Y  =  (y  -  y) 

For  convenience  let  x  =  y  =  0 
For  a  definite  positive  quadratic  form  it  is  necessary  that: 


The  fact  that,  over  the  entire  x,y  range,  the  integral  of  the  f(x,y) 
function  is  unity  (l)  is  used  to  determine  K^.  That  is: 
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completing  the  square  of  Qgi 


and  using: 


Jexp  cx^jdx  =  ^ 


Then: 
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The  factor  ^2.1^2  ~  ®'12  determinant  of  matrix  A. 


Therefore ; 


yiA? 

2it 


and  the  general  hivarlate  normal  error  distribution  is  written; 


f(x,y) 


VIaT 


2rt 


exp 


{-  i 


+  2a^xy  + 


Vw 

2rt 


exp 


h.2.  The  Bivariate  Error  Distribution  in  Terms  of  Statistical 
Parameters.  To  determine  the  significance  of  the  elements  a^^,  a^^ 
and  a^  of  f(x,y),  assvune  a  normal  bivariate  distribution  and  deter' 
mine  its  variance  and  covariance  by  use  of  the  moment  generating 
function.  From  section  3.4.  the  moment  generating  function  for  the 
univariate  case  is: 


E 


f(x)dx 
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For  the  bivariate  case: 


E 


!Xp  |ex  +  eyj  f(x,y)dxdy 


where : 


f(x,y) 


viir 

2it 


exp 


{■is} 


Therefore : 


E^exp  [0x  +  0y]}  -  |  Qg  +  Ox  +  0y}dxdy 


or: 


E|exF  [ex  +  ey]|  »  {“  i 


Expanding  the  right  side  of  this  equation: 


E|exp  [0x  +  0yl|  »  /exp  .  ^ 


+  2a^xy  +  a^^y 


®x*  +  V} 


dxdy 


®12  ®x 

111 


II  4\/  .  ®12®x  -  ®ll®yf .  1  .1 

-2h22  jy  " - iAj - 


dxdy 


where ; 


®22®x  ^  ®'ll®v  ”  ^®’12®x®v  11  2  22  2  12 

R  -  •  ■  -  - - - i^JLZ  «  B.  +  er  Qy  +  2a-^0^0y 


1. 


The  details  of  this  expansion  are  shown  in  Appendix  A 
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Letting 


Then: 

E|exp  [0x  +  0y]| 


Letting: 


E 


VIai 

2jt 


For  convenience,  and  a^  no  longer  denote  cofactors  (p  10 ) 

®22  ®11 

but  denote  the  elements  -jjj,  and  respectively. 
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2 


vnr 


V 


exp 


a  a  -  a 
11  22  12 


11  2  22  2  12 

+  aOy  +  2a-^0x0y 


I) 


Therefore ; 


E|exp  [0x  +  0y]|  =  exp  |+  |  |a^^0x  +  a^^0y  +  2a^0x0y|| 

The  variances  euad  are  obtained  by  evaluating  the  second  partial 
derivatives  of  E|exp  [0x  +  0y]|-  with  respect  to  0^^  and  0y  respectively 
at  03J  =  0y  «  0.  For  convenience  let  E  denote  E|exp  [0x  +  0y]|  in  the 
following  presentation: 

2 


^  =  E  a^^0x  +  a^0y^ 
^®x  ^  i 


^  =  E  •  +  (a“e^  +  a^Sj 


E  a^^0jj  +  a^0y 


At  0^  =»  0y  »  0 


2  a^E  _  11 

»  _  a 

^0x 


Similarly: 


y  a? 

^0y 
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22  .  .22^  .  _12, 


— ^  »  E*a  ■^1®  ®y‘*'®'  ®x 
Se,,  »  I 


22  12 
E  a‘^‘^0y  +  a-^0x 


At  “  0y  ■  0 


2  d  E  22 
0  “  — ^  “  a 

y 

bOy 


The  covariance 


0^  -  Ej(x  -  x)(y  -  y)| 


be^e, 


bE 

be.. 


22  12  ' 
E  a^‘'0y  +  a-^0x 


b% 

be^e. 


E  •  a^  +  a^^0y  +  a^0x 


E  a^^x  +  ®^®y 


E 


““  +  (a®®8y  a^Sx]  (a^\  +  a^Sy] 


At  0x  ®*  0y  «*  0 

_  ^^E  _  12 

From  the  previous  discussion: 

2 

or^  a  second  moment  of  x 


second  moment  of  y 


a  ®  pa  o  “  mixed  product  moment  of  x  emd  y 
xy  X  y 
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■but : 


11 

2  ®'22 

a  = 

=  lAl 

22 

2  ®11 

3,  s 

°y  “  TaT 

12 

b.22 

a  » 

PPxay  =  -jji- 

Therefore  the  moment  matrix  of  the  "bivariate  normal  distribution  is: 


Equivalently  A  « 

Following  the  procedure  outlined  in  paragraph  2.2.  for  inversion; 


Thus: 

«2 


Vy  -  P  ) 


2  f.  2v 

ay  (1  -  P  ) 
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f(X,Y) 


-yVtiTT) 


Since : 


X  "  (x  -  x)  and  Y  =  (y  -  y) 


f(x,y) 


2’"’v'’yV(l  -  P‘) 


exp 


If  p  s»  0  (case  of  Independent  errors) 


M 


* 

1 

2pXy\1 

2  (1  -  p^) 

<> 

4 

-  y) 

1 

(x  -  X 

0.^  ,  (y  -  y 

2(1-  p2) 

2 

‘^x 

2 

‘^y 

_2p  (x  -  x)(y  -  y)\ 

1 

1 

> 

1 

and: 


^‘(x,y) 


2i^ 


4  0 
°  4 


"x  "y  /J 


Showing  that  independent  errors  are  merely  a  special  case  of  dependent 
errors. 


5.  ANALYSIS  OF  THE  NORMAL  BIVARIATE  ERROR  DISTRIBUTION 

In  section  4,  the  equations  of  the  normal  bivariate  error  distribu¬ 
tion  were  determined,  and  the  elements  of  M  were  shoim  as  variances  and 

This  equation  results  from  the  assxui5)tion  p  »  introduced  in 

°^x°y 

section  3»5«  The  assunrotion  may  now  be  proven  correct;  Appendix  C, 
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covariances.  The  covariances  for  independent  errors  were  zero.  This 
section  is  concerned  with  reducing  a  normal  error  distribution  with 
dependent  errors  to  a  form  expressible  as  independent  errors  (covari¬ 
ances  zero) .  After  this  is  accomplished,  circular  errors  are  obtained 
by  use  of  the  methods  presented  in  ACIC  TR-56. 

The  quadratic  expression  for  independent  (Q^)  and  dependent  (Q^) 
bivariate  error  distributions  are: 


1  /x^ 

2  2  2 
1-P  CTy 


V/hen  coveuriances  are  zero  the  major  and  minor  axes  of  the  ellipse  coin¬ 
cide  with  the  axes  of  the  coordinate  system.  When  the  covariances  are 
not  zero,  there  are  dependent  errors  and  the  axes  of  the  error  ellipse 
do  not  coincide  with  the  coordinate  system.  Therefore,  removal  of  the 
non-zero  covariances  from  dependent  errors  is  equivalent  to  a  rotation 
of  axes. 
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The  process  of  diaconalization  of  the  covariance  matrix  is  used  for 
the  rotation. 

Diagonal! zat ion  is  interpreted  as  follows:  If  a  point  p  is  allowed 
to  move  freely  around  the  perimeter  of  an  ellipse,  there  are  four  posi¬ 
tions  where  the  rate  of  change  of  the  distance  (D^)  between  these  posi¬ 
tions  and  the  center  of  the  ellipse  is  zero.  These  four  positions 
correspond  to  the  points  of  intersection  of  the  principal  axes  of  the 
ellipse  and  its  perimeter.  The  problem  then  is  to  find  the  maximum 
and  minimum  value  of  p  as  it  traverses  the  elliptical  path.  This  in¬ 
volves  finding  the  extreme  values  of  a  function  of  two  variables  with 
one  side  condition.  Introducing  the  Lagrangian  multiplier  ( \) : 

=  F  +  Xg 

where : 

P  p . 

F  is  (x  +  y  )  the  square  of  the  length  of  the  radius  vector^  p. 
g  is  the  side  condition  (the  equation  of  the  ellipse). 

+  Saj^xy  +  -  C  =  0 

or; 

C  -  +  2a^xy  +  a^gy^)  =  0 

Thus: 

»  x^  +  y^  +  X  (C  -  a^^^x^  -  2a^xy  -  ag^y^) 
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2  2 

The  extreme  values  of  occur  when  and  equal  zero. 

ox  oy 


=  2x  -  \  (aa^iX  +  aa^^y) 


X  -  X.  (a^x  +  a^y) 


similarly: 


|Df 

Sy 

Note  that: 


y  -  X  (a^x  +  aggy)  »  0 


^11  ^12 


®12  ®'22 


11  12 

a  a 

12  22 

a  a 


(a,,a^^  +  a.«a-^  »  l),  (a,,a-^  +  a  ^a 


12 


12 


22 


11“ 


*12" 


(a^a^^  +  a^^a^  »  O),  (a^^a^  +  a^j^a^^ 


22 


12" 


*22" 


Since  A^A""*"  »  I 


1  0 
0  1 


v„  .11  V,.  .12 


Multiplying  the  hy  a  and  -g —  "by  a  yields: 


-  X  (a^Ta^^  +  a,„a^) 


a^y  -  X  (a^a-^x  +  Sgga-^y) 


*11"*  “  '  “12" 
12.,  .  .  _12. 


0 

0 


Adding : 


^  +  a^y  -  X  I  X  (a-^a^^  +  a^.a^)  +  y  (a  ^a-*"*-  +  a  a-^  ) 


12> 


11 


12 


,11 

*12  ‘*22’ 


.12 


or: 


a^^  +  a^y  -  Xx  =  0 
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TO  ^t)2  pp 

Similaxly,  multiplying  by  a  and  by  a  yields: 


a^x  -  X  (a^a^x  +  aj^a^y)  -  0 
a^^y  -  \  (a^a^^x  +  a^^a^^y)  =  0 


.12., 


.12. 


Adding : 


«12.,  ^  „22  . 
a  X  +  a  y  -  \ 


/  12  22%  /  12  22v 

X  (aj^j^a  +  ajja  )  +  y  (a^^a  *  a^^a  ) 


=  0 


or: 


Therefore i 


12  22 

a  x  +  a  y-Xy  =  0 


a^^  +  a^y  -  Xx  =  0 
12  22 

a  x  +  a  y-Xy  =  0 


Collecting  terms: 


X  (a^^  -  \)  +  a^y 

xa^  +  (a^  -  X)  y 


0 

0 


To  have  non-zero  values  for  x  and  y  the  determinant  of  the  coefficients 
of  the  tvo  equations  must  equal  zero. 


-  \ 

al2 

a^ 

a22 

-  \ 


The  expansion  of  the  determinant  is  considered  the  characteristic  equation 
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which,  in  the  bivariate  case,  is: 


>?  -  (a^^  +  a^^)  \  +  a^^a^^  -  (a^)^  =  0 

Solution  by  the  quadratic  fonnula  yields: 

-  b  ±  V  b^  -  4ac 
^  ^ - 

where; 

a  =»  1 

I  =  -  +  a^)  =  -  {<1  +  0^) 

c  »  a^^a^  -  (*12)^  “  "  P^) 

Therefore : 


But  for  independent  errors  p  =  0. 
Consequently; 
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or: 


That  is,  the  oquare  roots  of  and  Xg  correspond  to  the  maximum  and 

2 

minimum  values  of  D  ,  Since  X^^#  and  Xg  also  correspond  to  the  squares 
of  the  lerigths  of  the  principal  axes  of  the  standard  error  ellipse, 
it  can  he  concluded  that  the  magnitudes  of  the  principal  axes  are 
andV^*  This  is  true  for  dependent  errors  as  well  as  for  independent 
errors.  The  process  of  diagonalization  reduces  to  the  formation  and 
solution  of  the  characteristic  equation  of  the  determinant  of  the 
Inverse  of  the  moment  matrix. 


6.  AMUSLS  OF  THE  NORMAL  TRIVABIATE  ERROR  DISTRIBUTION 

The  theory  of  the  normal  bivariate  error  distribution  can  be  gener¬ 
alized  to  cover  the  normal  error  distribution  for  3  or  more  variables. 

In  this  section  the  trivariate  case  is  considered,  but  a  complete  deri¬ 
vation  is  not  presented  because  the  end  value  is  visualized  as  an 
extension  of  the  bivariate  case. 

6.1.  General  Form.  The  general  normal  triveuriate  error  distribution 


4o 


is  written: 

f(x,y,z) 
where : 


''3°=®  {-is} 


VT 


+  2a^  +  Sa^^XZ  +  a^gY^  + 


X  =  (x  -  x)  Y  =  (y  -  y)  Z  =  (z  -  z) 
For  convenience  let  x  =  y  =  z  =  0 
The  moments  of  the  distribution  are  shown  as: 


variance 

of 

X 

a 

all 

a 

4 

22 

2 

y 

a 

a 

a 

‘^y 

z 

a 

a33 

a 

covariance 

of 

X 

and  y 

a 

al2 

a 

°xy 

X 

and  z 

a 

al3 

a 

®xz 

y 

and  z 

a 

a23 

a 

6.2,  Axes  of  the  Error  Ellipsoid.  The  characteristic  equation 
for  the  tri variate  case  is  obtained  by  expanding  the  determinant 


11 -X 

al2 

al3 

12 

a22.  X 

a23 

13 

a23 

a33 

-  \ 


1. 


Derived  in  Appendix  B 
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It  will  "be  of  the  form: 


-  rX^  +  sX  -  t  =«  0 


where : 

r  =  all  +  a22H-a33 

s  =  a^V^  +  al"a33  +  a22a33  -  (a^)^  -  (al3)^  -  (a23)^ 

t  =  a^^a^^a33  +  2a^a^3a23  _  g^ll  (a^3)  _  a^22  (^^3)  _  a_33  (a^) 

The  first  root  (Xg,)  is  found  hy  applying  Newton’s  method  to  the 
polynomial  in  question  (x3  -  rX^  +  sX  -  t  =  O)  and  utilizing  the 
first  derivative  and  an  approximate  value  for  Xg.  By  successive 
iteration  the  root  can  he  solved  for  as  many  correct  digits  as  re¬ 
quired.  After  the  value  of  one  root  is  obtained,  the  cubic  can  be 
reduced  to  a  second  degree  polynomial  and  solved  by  the  quadratic 
formula  for  the  remaining  two  roots.  The  procedure  is  as  follows; 

f(X)  “  x3  -  rX^  +  sX  -  t  =  0 
f'(\)  “  3^^  -  2rX  +  t 


Solution  of  first  root; 


1 


Let  Xj^,  be  first  approximation 


^2  ”  "  f'lX^) 


1. 


A  first  approximation  is  the  larger  of  the  diagonal  elements, 

11  22  33 
a  ,  a  or  a"'"’. 
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successive  iteration: 


K  = 


,  f(>2) 

h  - 


'•n  Vl 


Let: 


Applying  synthetic  division  for  the  remaining  roots: 


aX^  +  (h  +  aXg^)  X  + 


c  +  (h  +  aX^)  X^ 


Let: 


A  =<  a 


B  =  h  +  aX„ 


C  «=  c  +  (h  +  aX^)  Xg 


Then: 


-  B  +Vb^  -  4ac 
2A 


“ 


-  B  -V  b^  -  4aC 
2A 


Therefore,  the  variances  are  hnown  and  the  axes  of  standard  error 


1+3 


ellipsoid  are: 


a  =  ^JT^ 
b  = 

c  « 

7.  ORIEMTATION  OP  THE  ERROR  EUUPSE  AHD  ELLIPSOII> 

The  orientation  of  the  error  ellipse  or  ellipsoid  must  be  deter¬ 
mined  to  complete  the  geometrical  description  of  an  error  distribution. 

It  has  been  concluded  in  previous  sections  that  the  covariance  matrix 
contains  the  consteuit  coefficients  of  the  quadratic  expression  of  the 
error  ellipse  and  that  the  principal  axes  of  the  error  ellipse  are 
obtained  by  diagonalizatlon  of  the  covariance  matrix.  The  operation 
provides  the  maximum  and  minimum  errors  of  prescribed  probabilities 
and  is  con^parable  to  expressing  the  error  ellipse  in  its  standard 
form.  It  is  possible  to  construct  equi -probability  curves  around 
the  mean  value  of  the  error  distribution  by  multiplying  these  inde¬ 
pendent  error  values  by  a  particular  conversion  factor  (Theory  of  Errors, 
AGIO  TR-96).  To  construct  the  equi -probability  curves,  the  orienta¬ 
tion  vith  respect  to  the  original  axes  must  be  determined  by  solving 
for  the  direction  cosines  between  the  original  coordinate  axes  and 
the  principal  axes  of  the  error  ellipse.  The  following  general  theory 
and  solution  holds  for  both  the  bivariate  and  trivariate  cases. 

7.1.  General  Theory.  Matrix  theory  coincides  with  and  mal:es 
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exp].icit  use  of  vectors  and  vector  properties.  The  rows  of  a  matrix 
are  considered  row  vectors  and  the  columns^  coliunn  vectors.  The 
elements  of  the  matrix  are  components  of  the  vectors.  The  solution 
for  the  direction  cosines  involves  determination  of  the  cosine  of  the 
ancD.e  between  the  oricinal  coordinate  axes,  (x,y),  and  the  positive 
direction  of  the  principal  axes,  (x',y')  of  the  error  ellipse. 

From  vector  analysis: 

■  —  — ^  — ♦ 

a  •  h  =  lal  |h|  cos  a  (l) 

where : 

a  •  b  =  dot  product  of  the  two  vectors  a  and  b 

|al  lb I  =  product  of  the  macnitude  of  the  vectors  a  and  b 

cos  a  =  cosine  of  the  anyle  between  the  vectors  a  and  b 

Diagonalization  of  the  covariance  matrix  yielded  values  which  were 

the  latent  roots  7^,  and  X^)  corresponded  to  the  squares  of 

the  lengths  of  the  principal  axes  of  the  standard  error  ellipse.  In 

converting  the  quadratic  form  of  the  dependent  errors  (covariance 

matrix  with  non-diagonal  elements  unequal  to  zero)  to  a  quadratic  form 

1 

of  independent  errors  (diagonal  matrix),  a  coordinate  transfomiation 
has  taJcen  place.  Therefore,  there  should  be  a  transformation  matrix 
which,  \7hen  applied  to  the  covariance  matrix,  vdll  yield  another  matrix 

1. 

In  this  instance,  where  the  mean  value  of  the  distribution  was 
chosen  as  the  origin  of  the  coordinate  system,  a  rotation  lias  tal'.en 
place  whereas  in  the  general  case  it  i/oxild  be  a  transformation. 


45 


with  the  latent  roots  as  its  diagonal  elements. 

1 

By  definition,  the  latent  vector  of  a  linear  transformation,  as 
described  above,  is; 

AX  =  (2) 

where : 

A  =  covariance  matrix 
\  =  latent  root 
X  =  latent  vector 

7.2.  Direction  Cosines  for  the  Bivariate  Case. 

7.2.1.  Derivation. 

From  eq.  (2)  AX  =  XX 


or: 


a 

a 


lA 


12^ 


®12^1 


22  1 


X,Xi 

Vl 


(3a) 


(ail  -  ^1  "  " 

®12^1  ^^22  "  ^1  “  ^ 


(3bl) 

(3b2) 


Since  the  cosines  of  the  angles  between  the  vectors  are  involved, 
it  is  possible  to  assign  any  value  to  one  of  the  vector  components 
and  solve  for  the  other  with  respect  to  the  first. 

Letting  “  1  in  equation  (3Bl) 

Refn,  Computational  Methods  of  Linear  Algebra,  pp  37 
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Then: 


-  (s-ii  “  ^i) 

Y  a  - ±= - =_ 

1  a 

12 

or  solving  (3'b2) 

Y  a  “  . 

h  (agg  -  \) 

The  values  and  when  placed  in  eq.  3^1  and  3'b2  satisfy  the  equa¬ 
tions  and  are,  therefore,  the  latent  vector  components  of  the  latent 
root 


Similarly  for  the 

latent  root  (Xg) 

^  “  V2 

(W) 

or: 

(a^j^  “  ^12^2  ~  ^ 

a-jpXp  +  ( agg  -  )  Yg  —  0 

Letting  Xg  »»  1 

>^2 

-  ~  (^n  " 

(ag2  -  ^2^  ®12 

Xg  and  Yg  are  the  vector  components  corresponding  to  the  respec¬ 
tive  roots  and  are  the  components  of  the  X  matrix  in  equation  (2). 


(5) 
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FrcM  eq.  (l)  (a  •  “b  »  |a|  jbj  cos  Of)  it  is  necessary  to  compute 

the  dot  products  of  a  and  h  and  substitute  them  into  eq.  (l). 
The  cosine  of  the  angle  between  the  +x  and  +x'  axis  is: 

li  »  a^  (unit  vector  along  x  axis) 

"  bj^  (vector  along  x'  axis) 

a  •  b  » 

|a|  |b|  -  V7 

^1 

cos  Ojji  “ 
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Cosine  of  the  angle  between  the  +x  and  +y'  axis: 


1  s»  a 
•^i  ^'i 


-  +  Ygj  =  bg  (vector  along  +y’  axis) 


cos  a. 


-  Xg 


12 


2  "2 

Angle  between  the  +y  axis  and  +x'  axis: 


Ij  =  ag  (xmit  vector  along  +y  axis) 


"ll  ^ 


cos 


Ogi  = 


Angle  between  the  +y  axis  cind  the  +y'  axis: 


7.2.2.  Conqiiitation  Method.  The  direction  cosines  are 
obtained  by  writing  the  latent  vectors  in  form  of  eq.  (5);  sxanming 
the  squares  of  all  elements  of  each  individual  colmim;  extracting 
the  square  roots;  and  dividing  each  element  of  the  matrix  (5)  by 
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the  square  root  of  its  column. 

X’  y' 

(6) 


By  definition  the  direction  cosines  measure  the  angle  hetween  the 
original  positive  axis  and  the  positive  principal  axis  of  the  error 
ellipse.  The  angles  whose  cosines  are  positive  (+)  are  less  than  90°; 
the  angles  whose  cosines  are  negative  (-  are  euigles  of  180®  minus 
the  angle  of  + 

For  example  consider  the  cosines  as; 

X 

y 

The  angle  "between  x  and  x'  is  90°  or  less 

y  and  x'  is  90“  or  greater 
Therefore,  x'  must  "be  in  the  4^^  quadrant. 

The  angle  "between  x  and  y’  is  90°  or  less 
y  and  y'  is  90“  or  less 
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+y 


7.3*  Direction  Cosines  for  the  Trl variate  Case.  The  direction 
cosines  for  the  trlvarlate  case  are  found  in  the  same  manner  as  the 
hi variate  case.  However,  the  addition  of  a  new  coordinate  axis  (z) 
and  another  vector  causes  difficulty  In  the  solution  of  the  latent 
vectors.  In  the  trivariate  case  there  are  3  latent  roots  (\)  which 
must  he  solved  to  obtain  9  latent  vector  con^nents. 

From  eq.  (2) ;  AX  «»  XX 
For  the  latent,  root  X^^; 

®’ll^  ®12^n  ^13^^  “ 

®12^n  ^  ^22^n  ^  ®23^n  “  Vn 

\3^n  ®23^n  ^33^n  " 
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Where  n  refers  to  any  one  of  the  3  latent  roots  or  X^) 


or: 


S  0 

“0  (7h) 

a  0 
1 

Since  the  determinant  of  this  system  equals  zero  the  solution  presented 
in  Coordinate  Geometry,  pp.  lllt--115  Theorem  [22.1],  is  applicable. 

Then; 


(^11  -  ^n  ^  ^13^n 

aigXn  +  (022  "  ^n  ®23^ 


^n*  ^n‘  “  |®12®23  “  ^®22  "  ®'13|*  "  j^^ll  “^1^*23"  ®12®'13|  * 

|(a,,  -  X  )(a„  -  X  )  -  a,^a,_l 
r  11  n''  22  n'  12  12J 

“  {(®22  “  Ni^^*33  ”  ■  ®23®23)'  “  j*l2  (®33  "  ”  ^13®23)* 

j*12®23  ■  ®13  ^®22  " 

-  -  ja^  (a23  -  X^j)  -  a23aj^3  j :  -  Xn)(a33  ~  -  013^131 : 

"  |^®ll  "  ®23  “  ^12^13! 

Because  this  is  the  equation  set  equal  to  zero  in  section  5/  the 
determinant  of  the  system  must  equal  zero  to  determine  the  values 
of  X^. 
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Tlie  ratios  of  the  latent  vectors  may  he  computed  from  any  one  of  the 
above  equations.  For  example: 


^1  “  ^12®'23  "  ^®'22  “  ^13) 

or: 

X,  "  -  K)  -  >  etc. 

1  r  22  1^'  33  r  23  231 

The  latent  vectors  of  the  other  roots  are  then  solved  similarly  and 
the  vector  matrix  X  is  formed. 
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where; 


The  solution  of  equation  (8)  allows  for  the  signs  of  the  vector 
components^  and  orientation  is  similar  to  that  in  the  bivariate  case. 
That  iB,  the  direction  cosines,  as  given  in  matrix  (lO),  measure  the 
asagles  between  the  respective  axis. 

For  exenqile: 

z 

I 

I 

I 


I 


As  oriented  using  x',  y'. 


z'  direction  cosines  are; 


X 

y 

z 


X'  y'  z' 

+  -  + 

+  +  - 

-  +  + 


7.4.  Basic  Properties  of  Direction  Cosines.  Checks  resulting 
from  the  basic  properties  of  cosines  to  insure  correct  values  are: 


IF»1  I¥»l  ns»l 


b.  To  check  the  perpendicularity  of  the  principal  axes. 

Bivariate  case; 

cos  a  cos  a  +  cos  a  cos  a  =0 
11  21  12  22 

'  Trivariate  case ; 

cos  a  cos  a  +  cos  a  cos  a  +  cos  a  cos  “  0 

11  21  12  22  13  23 

cos  a  cos  a  +  cos  a  cos  a  +  cos  a  cos  a  *»  0 

11  31  12  32  13  33 

cos  Og^cos  +  cos  a^coe  +  cos  ® 

c.  The  determinant  of  the  [cos  must  equal  +1 

d.  Each  element  in  [cos  must  equal  its  cofactor 

e.  X"^AX  »  \ 

By  multiplying  the  inverse  of  the  latent  vector  matrix  by  the  covariance 
matrix  and  -che  latent  vector  matrix,  a  diagonal  matrix  is  obtained  which 
has  the  latent  roots  as  its  diagonal  elements. 
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3.  APPLICATION  OP  THE  MOtffiNT  (COVARIANCE)  MATRIX  TO  lEAST  SQUARES 
ADJUSTMENTS  INVOLVING  CORRELATED  OBSERVATIONS 

In  many  geodetic  investigations  least  squares  adjustments  -  a 
special  "branch  of  statistics  -  are  used  to  obtain  consistent  estimates 
of  measured  variables  and  to  provide  estimations  of  the  reliability 
of  the  estimates  (i.e.,  standard  errors). 

This  section  contains  a  matrix  solution  of  a  general  least  squares 
problem,  and  shows  how  a  system  of  normal  equations  is  related  to  the 
covariance  matrix,  and  how  the  theory  of  the  preceeding  sections  eire 
used  to  reduce  a  system  of  correlated  observations  to  one  involving 
derived  observations  which  are  xmcorrelated. 

8.1.  Observation  Equations.  Suppose  the  following  system  of  obser¬ 
vation  equations  is  given: 


ax  +bx  +  cx.+  .,.rax  +  s 
11  12  13  im  1 

ax  +bx  +  CX  +  ...mx  +  b 

21  22  23  2in  2 

ax  +bx  +  CX  +  ...mx  +  b 

ni  n  2  “3  nm  n 


n 


where : 

a,b,c,  ...,  m, s  are  conBtantB  known  fVom  the  theory  of  the  observa¬ 
tions,  Z  is  the  quantity  observed  and  x^,  x^,  ...,  Xj^^  are  unknowns  to 
be  found. 

If  the  observations  were  without  error,  these  equations  would  be 
satisfied  by  the  true  values  Ig,  1^^^)  of  x^^,  Xg,  ...,  x^. 
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Since  all  observations  are  subject  to  small  errors,  there  is  no 
system  of  values  for  the  unknowns  which  satisfies  the  equations 
exactly.  As  previously  mentioned,  one  of  the  purposes  of  a  least 
squares  adjustment  is  to  find  a  system  of  best  estimates  (x^,  Xg, 
Xj^)  for  the  unknowns. 

Let  h^,  hg,  h^,  . . .  >  ^  values  of  the  lefi;  side  of  the 

system  of  observation  equations  when  any  assumed  set  of  values 
(x^,  x^,  x^)  for  the  unknowns  is  taken.  Then  the  errors  (or 

more  strictly  the  residuals)  of  the  observations  are  given  by; 

Vi  “  ^i  “  Zi 

where ; 

1  **  1,  2,  • . . ,  n 

Letting: 


ki  =  Zj  -  s^ 


the  system  of  observation  equations  is  written: 


a  X-  +  b  X*  +  c  x_  +  ...  +  m  X  -  k„  =  v„ 
nl  n2  n3  n®  a  n 
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Introducing  matrices^  let 


where : 


K  « 
nxl 


ai2  . . . 

^Im 

A  » 

nxm 

®21 

•  •  • 

•  •  • 

^2m 

_^nl 

®n2  **• 

®’nm 

“ 

^22  “ 

•  •  •  • 

^22  " 

•  •  •  • 

^2 

> 

• 

,  etc. 

• 

®nl 

a 

n 

®n2  “ 

b 

n 

- 1 

^1 

^1 

^2 

« 

,  X  » 

^2 

• 

,  V  - 

^2 

• 

• 

• 

nxl 

. 

_ 1 

nxl 

• 

• 

/n 

X  » 
nscl 


weight  matrix 
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The  residuals  of  the  observations  are  given  by: 


V  =  -  K  +  AX 
nxl 


If  X  has  the  value  X, 
(l)  V  •=  -  K  +  AX 


8.2.  The  Theory  of  Least  Squares.  The  theory  of  least  squares 
requires  that  the  sum  of  the  squares  of  the  weighted  residuals  be  a 
minimum,  that  is  [pv^]  or  [pw]  equals  a  minimum.  A  necessary  con¬ 


dition  for  the  fulfilment  of  this  requirement  is  that  the  m  peirtial 


derivatives  of  [pw]  with  respect  to  Xp  ...,  be  zero: 


(2)  ^  [pw]  -  2 

dXj 


8v, 


5v, 


n 


P-V-  +  ...  P„V_ 

1  1  axj  n  n  5xj 


0 


where : 


j  “  1,  2,  •  •  •  t 

Prom  ( l) : 

where ; 

i  “  1,  2,  n 

i  ■  1,  2,  ...,  m 


8vj 
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An  alternate  way  of  writing  (2)  Is: 


A^.P.V  0 

Inserting  (l)  into  this  equation  yields: 

A^*P  .  (-  K  +  AX)  «  0 


or: 

T  -  T 

A  ‘P^Aii  »  A  .P.K 

n  T 

0.3.  Solution.  The  matrix  product  A  ‘P^A  is  equivalent  to  B,  the 
symmetric  coefficient  matrix  of  the  normal  equations  for  the  system  of 
observation  equations.  Thus  the  preceeding  expression  may  be  written: 

BX  »  A^.P.K 
T 

Letting  A  'P'K  equal  C,  the  solution  for  the  unknowns  in  matrix  nota¬ 
tion  is: 

X  » 

8,4.  Verification,  [pw]  can  be  obtained  from  the  matrix  product: 

[pw]  ■  V^*  P*V 

To  verify  that  V  actually  minimizes  [pw],  consider  another  set  of 
corrections  V  and  values  X'. 
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In  this  case: 


V  »  -  K  +  AX' 


Subtracting  V  from  V : 

V  -  V  B  A  (X*  -  X) 

Now: 


V  o  (V  -  V)  +  V 


and: 

[pv'v'l  «  V'^*P*V' 

Substituting  V  ••  (v  -  V)  +  V: 

f  iT 

[pv'v']  -  |^(V'  -  V)  +  vj  -  V)  +  vj 

Applying  the  distribution  laws  of  matrix  multiplication: 

T  T 

[pv'v']  ■  (V  -  V)  ‘P^CV  -  V)  +  (V*  -  V)  'P'V 

+  V^’P-(V'  -  V)  +  V^-P-V 


rearranging  terms: 


[pv'v'l  ■  V^*P*V  +  (V  -  V)^‘P'(V'  -  V)  +  (V  -  V)^‘P*V 


+  V^*P*(V'  -  V) 


6l 


Substituting  (V’  -  V)  “  A  (X'  -  X)  into  the  third  and  fourth  terms: 
[pv'v']  »  +  (V‘  -  V)^-P.(V'  -  V)  +  |a  (X'  -  X)|  ^‘P^V 

+  v'^-p.  |a.(X’  -  X)) 

-  V^*P*V  +  (V  -  V)^*P*(V'  -  V)  +  (X'  -  X)^*A^*P*V 

+  V^‘P‘A*(X'  -  X) 


hut: 


T 

A  -P-V  »  0 


thus 


T  T 

V  ‘P  ‘A  ■ 


0 


and 

m  m 

[pv'v']  »  V  ‘P'V  +  (V  -  V)  •P'CV  -  V)  +  0  +  0 
■  [pw]  +[p  (▼'  "  v)(v'  -  v)j 
"  [pw]  p  (v*  -  v)^j 

The  fewtor^p  (v'  -  v)  j  la  positive  or  equal  to  zero.  Thus  it 
is  seen  that  [pv'v']  is  a  minimum  when^p  (v'  -  v)^j  is  zero  or  when 

V  -  V. 
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8.5.  Moment  Matrix.  Now  assume  that  the  true  values  6^,  6g, 

....  and  true  errors  e,>  €^»  ...»  e_  were  known, 
m  12® 

Introducins: 


^1 

E  = 

*2 

• 

• 

and 

g  t  B 

^2 

• 

• 

S' 

«  - 

_ 1 

• 

in 

where ; 

Ci  =  Xi  -  li 

[pec]  =  the  sum  of  the  squares  of  the  weighted  true  errors 


hut : 

c'  -  V 
.*.  [pec] 


hut; 

T 

A  .P.A 


[pw]  +  p  (e*  -  V)^ 

T 

[pw]  +  (c'  -  V)  ‘P'Cc*  -  V) 

A  (E  -  X) 

T 

[pw]  +  jA.(E  -  X)|  .p.  jA.(E  -  X)| 

[pw]  +  (E  -  X)'^.A^*P'A  (E  -  X) 


B 
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and: 


-vT 


[p€e]  =  [pw]  +  (E  -  X)  ‘B-Ce  -  X) 


o  -  T 

=  +  (E  -  X)  ‘B'CE  -  X) 

where : 

q  <=  V  [pw] 

From  statistical  theory  it  is  knoxm  that  the  normal  error  distri¬ 
bution  of  x^,  x^  and  q  can  be  written  in  the  form: 

f  (x^,  q)  =  K  exp|-  i  q| 

where : 

(3)  Q  (quadratic  form  of  the  error  distribution) 


0  =  (X  -  E)  -B-CX  -  E) 


(ref.  1) 


a  *»  the  variance  of  a  single  observation  after  adjustment. 


and: 


K  is  a  constant  corresponding  to  Q. 

It  was  shown  in  section  4.2.  that  Q  of  a  normal  bivariate  error 
distribution  is: 

T  1 

Q  «  [X  Y]  .M"-‘-‘[X  Y] 

where : 

«  the  inverse  of  the  moment  matrix. 

Con^jaring  this  expression  to  (3)  indicates  that: 


B_ 


64 


Multiplying  from  the  left  "by  M: 


MM 


-1 


Multiplying  from  the  right  by  B 

IB"^ 


-1. 


MBB' 


-1 


B 


M 


or; 


2  -1 

M  =  (T^B 


The  latter  equation  states  that  the  moment  matrix  (or  covariance 
matrix)  of  the  best  estimates  of  the  urJuiowns  is  equivalent  to  the 
product  of  the  veiriance  of  a  single  observation  and  the  inverse  of 
the  coefficient  matrix  of  the  normal  equations. 

M  in  the  multivariate  case  is; 


M 

mxm 


A 


Pv  X  ®X 
12  1  2 


Px  X  ®x,^x 
1  m  1  m 


Px,x_®x,®x_  ^ 


*rm  "1  m 


m 


m 
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vhere  the  diaconal  elements  are  variances,  the  non-diaconal  elements 
covariances,  and  the  p's  correlation  coefficients. 

8.6.  Transformation  of  Errors.  In  the  case  of  independent 
(uncorrelated)  errors,  the  p's  are  zero  and  M  is  a  diagonal  matrix 
or  equivalently  is  a  diagonal  matrix;  in  the  case  of  dependent 
(correlated)  errors  the  p's  are  not  zero  euid  is  not  a  diagonal 
matrix.  Thus  it  may  he  concluded  that:  if  B"^',  for  correlated 
observations,  is  transformed  into  a  diagonal  matrix,  then  uncorrelated 
errors  are  obtained. 

To  effect  such  a  transformation  the  process  of  diagonalization  is 

txsed  (section  5  fo^"  the  bivariate  case).  For  the  multiveiriate  case, 

the  determinant  of  B“^,  vrith  a  factor  \  subtracted  from  each  diagonal 

term,  is  expanded  and  set  equal  to  zero.  These  operations  yield  an 

m"^^  degree  characteristic  equation  having  m  real  roots.  The  roots 

2 

when  multiplied  by  a  yield  the  variances  of  the  imlaiovms  in  an 
imcorrelated  sense.  The  standard  errors  are  found  by  extracting  the 
square  roots  of  the  variances. 
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APPENDIX  A 


EXPANSION  OF  THE  NORMAL  BIVARIATE  MOMSIOT  GENERATING  FUNCTION 

(Reference  No.  18) 

In  section  it  was  asserted  that: 

E|exp  [0x  +  0y]|  =  — / exp  |  -  |  ja^^x^  +  2a^xy  +  a^^y^j 

■^-00  -'-00  . 


+  +  e^yldxdy  (l) 


where : 


R  = 


1 

—  a 
2  11 


^12  ®x 

‘‘r~ 

^■11  ®ii 


+  ~  ^ll^y 

IA| 


IA| 


l«) 


dxdy  (g) 


Let: 


a  »  gx  [the  exiponential  in  (l)] 


-  2a^xy  -  a^^y^  +  29^x  +  29^ 


eind: 


Pi 


aioX  e. 


a^l  X  f 


^11  *^11 


A-1 


Pc 


"  r22 " 


;i2' 

^11] 


y  + 


^12®x 

lAl  "  |A| 


To  prove  that  (l)  equals  (2)  it  will  suffice  to  show  that: 

a  »  +  pg  +  R 


or  equiveilently  that: 


R  =  a  -  -  Pg 


^1  “  ’^11 


^  ,  ^12  ®x 
11  11 


\2 


-2  .  ^12 


®x  ®'12  ®'12  o  ^12®x^  ®x* 

H  XX  XX  ^xx 


2 

®11 

“11 

'l2®xy  . 

2 

2 

®11 

^1 

2  2  2 

2  «  2a^e  y  a^py  8^ 

a,,x^  -  2a,_xy  +  20  x  +  — ==-= - ==-— - =- 

11  12  x  a  a  a 

11  11  11 


h2  \  /  „  .  ®12®x  ®ll®y 

*  I  y  »  '  'a'a  • '  •  ‘7'a  • 


^2  -  -  K2 


"11 


|A|  |A| 


®12\  /  2  .  ^®12®xy  ^®ll®y^  ^®ll®12®x®y  .  ®12®x  .  ®ll®y 

■  “u  r  ■  ““  ■  lAI®  IA|2  IA|2 


A-2 


Expanding; 


2  ,  ^12^  ^®'12®22®x^  ^®'ll®'22®y^  ^®'ll®'12®y^ 

"  ®22^  ■  |AI  ^  '  '^‘®11 

+  ^^ll^i2^22Vy  _  _  ^12^22^x  ^  ^12^x  _  °'11^22^y 

lAl^  '^'%1 

2  2-2 
^  ^11^12^y 

lAl  ^a^^^ 


Collecting  terms: 


-R  a  -a  +  6  +p 
^1  2 


-R 


0 


9 


9 


9 


9 


^11^  +  2a^xy  +  a^gy  -  28^x  -  26^  -  a^^x  -  Ra^^^xy  + 


9 

^^12V 

a 

11 


(D  •  ®  d)  9 

.  2fl*,  .  fj2L  .  ^  .  ,*,2  *  f^L  ^°12°ggV  , 

^®x  a^^  22^  a^^^  "  |A|  |AI  a^^ 


9 


,  ^^1°22V  ^^1^12V  ,  ^^l^I2^22Vy  ^^l^iR^y 


~m 


|A|a. 


11 


|A|‘ 


lAl  ^a 


11 


•  •  •  O 

2  -2  k  P  2  „2  2  2  „2 

_  ^  ^12^x  _  ^ll°22^y  ^  °'11^12^y 

lAI^  '^'^®^11  '^'%1 


A-3 


Combining  terms  (small  numbers  circled  above  expressions  indicates 
expressions  combined) 

© 

® 

_  aa^^e^y  2a^e^y 

®  ®11  '  ^  *^11 


2  2 

aj^2^  -  “  0 


aa^^xy  -  2a^xy  »  0 


^aggy  -a^^y 


0 


+  20^  -  2e^x  a  0 


2|A|  a^e^y  -  +  2a^0^ 


lAl  a 


11 


■  ^la^x^  ~  ( ^11^  ~  ^ig) 


lAla 


11 


Since : 


®11®22  ”  ®'12  “ 


n  0 


2a^0^y  -  2a^0^ 


2  2  2  2 


(D 


^■11 


^i2y 


+  '■'■  "  ■■]%>'"*'  ■  •  “W'i"'’  ' 


1A\ 


W 


11 


Since : 


^11^22 


lAl  + 


(2IAI  t  2a^  -  2i4)  V 
_ 


2d 


/ 


-  20  y  +  20  y  a  0 


y 


(D 


^  ^^1^12^Vy  ^^ll4Vy  ^  J 


lAl' 


lAl 


11 


2a, -  2a,  ^ 
11  12  22  12 


I  0  0 

I  x"y 


lAl 


I ‘‘11*22  -  Vy 

lAl^ 


®^12®x®y 

lAI 


®  - 


2  2 
*^12^22^x 
IA|2 


a^  0^ 
^12®x 


0' 


'*'^'4  -  »ii“£e44  ^  44 


lAl  ^11 


lAl  ^a 


11 


|''|^4-44(“ii“22-4) 

«•  MM  I  II  I  ■  infill  ■  II^MI  ■■  ■  II  I  M  ■!  I 


lAl  ^a 


|A|202.  lAla^02 


11 


IaI  ^a 


11 


A-5 


lAl  +  _  ®x  I  ®11®22  “  ®12  ^12  _  ®22®x 

lAI  '  lAI  ‘  lAI 

0  .  4°22^y  ,  AA/y  „  ^  Wy  ^  44"y 

lAl  ^  |Al  lAl  ^ 

o2  I  2  \  -2 

O  ^y^ll  hll°22  ~  ^-Igj  ^ll^y 

lAl^  ^ 

Therefore ; 

-R  »  (D+(S)  +  ® 

„  _  ^®12Vy  ®22®x  ®U®y 

lAI  "  nra“  ‘  lAI 

or: 

a_«0^  -  2a, „0  0  +  a,,0^ 

R  .  ^2"^x  ^  ^  11  y 


Since 


1 - 1 

IS  tT 

®12 

®22 

1 

Hk" 
_ 1 

“  1  5 

®11  ®i2 

®12  ®22 

>  a^' 

a^  a22 

®12 

L' w 

®11 

TaT. 

Comparison  yields 


^■12  „12 
W  " 

etc. 

Thus:  R  may  also  be  written  as: 

R  =  a^^0x  +  a^^0y  +  2&^e^6y 


APPENDIX  B 


DEVELOPMENT  OF  THE  CONSTANT  FOR  A  TRIVARIATE  ERROR  DISTRIBUTION 

(Reference  No.  12) 

This  development  can  he  carried  out  by  introducing  a  change  in  the 
designation  of  the  coordinate  axes  and  following  the  procedure  used  in 
the  bivariate  case. 

From  section  6* 


f(x,y,z)  =  exp 


■  2  S| 


Taking  the  integral  over  the  entire  univerrstf} 

J-€0  -t-CA 


F(x,y/g) 
where ; 


•/// 


exp  <  -  i  Q^^dxdydz  it  1 


=  a^^x^  +  2a^xy  +  Sa^^*^  + 


■fOi-fW 


^  ^  exp  I  Q^jdxdydz 


Making  the  coordinate  notation  change: 


to 


'2 


B-1 


can  now  be  irritten  in  simplified  form  by: 


where ; 


i,J=l 


=  * 
yg  “  y 


iB  now  written: 

3 


Z 


^11  Pi  ^  a, 


^IJ^J 

i 


11 


^  Kj 


Letting: 


-1  “  ^1  •  a 


3 

L  njyj 


11 


Zg  »  yg-^ 


^23^3 

a  < 
22 


,  .  .  (ref.  11) 

ij  Ij  ^11 


B-2 


^•1*1  ” 


a  * 
22 


'  “kk 


a'*'*  B.^-* 

^k-l,k^k,k-l 

n  k-t 

k-l,k-l 


Using  these  substitutions  the  integral  becomes: 

-t-ao  -foa  -t-eo 


A. 

K. 


exp  .  i  a^^z2  -  I  -  I  a3*3z|  dZ^dZ2dZ3 


-«»  -«a  -• 

Next  it  will  be  sho\m  that: 


Q  ®  a  Z^  -  i  a  •  Z^  -  —  a  * 

^3  11^1  2  22^2  2  33^3 


Once  this  has  been  proven,  K3  can  be  found  by  integration. 
Proof:  In  a  symmetric  quadratic  form: 


&  an 

IJ  ji 


•  ®11 


11 


‘12 


21 


22 


ia2 

J»2 


22 


12 

^11 


B-3 


HICU 


•  m  ■III  PiiBiii—- 


‘33 


33 


i»3 

J“3 


a  « 

33 


2 

.!i3 


33  a, 


i-3 

J-3 


U 


a  V 

23 


.  ^1^°21 


1«2 

J»3 


23 


y  tigy  tii3y 

1  ®11  ®  *u  ^ 


aJL 

7  ■  Y  +  y 

^2  ^2  ^3 

^  a  ‘ 

22 


z  ■  y. 
3  3 


Using  the  above  substitutions: 


Ci) 


*11^ 


ll  2  , 

5  1*11^1  *  ^aigy^ya  * 


and: 


Zg  - 


y2  +  -f  y3 


yg 


®23  a,,  1^3 


11 


/  2  » 

2.0/ 

r22  “  a 

y2  +  2 

\  i 

\ 

*ll'‘23  a 


11 


^2^3 


1 

5 


+  JL  I  ^ll°23  "  ^12^13 


2  ®12  2 

^22^2  ■  ^2  ^2^3 


®22 


11 


^11®23 


(D 

/- - - - N 


®’12®13 


11 


0 


^11^3  ~  ^12^13 


11 


^3 


Also: 


?  ®33^3 


0 

0 

2  2 

1  \®  ^ 

a  y2  .  ®13^3  . 

1  1 

[^ll®23  "  ^12®13\  2 

33^3  a 

i  r ' 

Adding  j  ®^3*3^  |  combiniiig  like  terms  yields; 

k\hA*  *  ^sA  *  *  ^3A  1 


The  expression  within  the  bracket  is  Q,  QED 


B-5 


Now: 


Jexp  cx^  j  dx  B 

applying  this  Integral  to  the  Integral  for  ^  yields: 

K3 


^^2.1  *  ®^2  *  *^3*3  ^  written  in  a  more  convenient  form. 

Since : 


B-6 


^11  [  ®22  ■  ^33  ■ 


2 


2  ^  ^^23^13^12 

^23 


2  2 
^■13®  12 


‘11 


Expanding : 


“  ^11^22^33 


'‘22^13 


*33^12 


a  -  a^^a7-  -  a,  +  2a^^a^^a- 


*1i43 


23  21  31 


This  expression  is  merely  the  expansion  of  the  3^3  symmetric  deter, 
minant  |Al  : 


Therefore : 


or ; 


B-7 


APPENDIX  C 


PROOF  OF  ASSUMPTION  THAT  “  P'^x'^y  NORMAL  BIVARIATE  ERROR 
DISTRIBUTION 


In  section  4.3.  the  general  normal  ‘bivariate  error  distrihution 
was  derived  using  the  assumption  that  «  pa^jOy).  Determination 

of  the  mixed  product  moment,  (Uxy)  should  equal  p^x^y  assu33^)- 

tlon  is  correct. 

From  section  4.3. 


f(x,y)dxdy 


2itOj^OyV  1  - 


exp^ 


2  (1  -  P  ) 


2  ,  _,2 
(x  -  x)  (y  -  y) 

2  2 

a  o 

X  y 


2o  (x  -  x)(y  -  y) 
®x®y 


dxdy 


To  prove:  p^y  “  P®x®y 


*xy 


e{(x  -  x)(y  -  y)|  -  (x  -  x)(y  -  y)  f(x,y)(axdy 

J-ta 


Let: 


Then; 


u-it)  . 

®x 

and 

(y  zll  » 

X  -  X  « 

Vx 

y  -  y  *= 

Vy 

X  » 

Vx  ^  ^ 

y  " 

dx  “ 

a^dZi 

dy  « 

OjIJZb 

C-1 


Then  suhstituting  in: 


‘xy 


,  r  T - exp - i -  IzJ  -  2pZ^Z2  ^  z|] 

J.«,i<»2«o^Oy^l  -  ^  1  2  (1  -  p^)  '  ' 


>  a^dZ^OydZg 


For  a  given  distribution  the  quemtities  o^,  p  and  2«  are  constants: 

!■«  f 

j^Zg  exp  <  -  - 


•xy 


1  - 


2«^(1  -  p^) 


Z^-SpZ^Zg.Z^ 


I  2  (1  -  p'^) 


^dZ^dZg 


Introducing  two  new  variables; 


V  -  w 


V  +  w 


^  VT  ' 


VT  ' 


Then; 


z?. 


2pZ^Zg  +  2^  -  ^-^  +  ^-2p| 


v^  -  w® 

"1^2  “ 


v^  w^\  .  .  2vw  w^ 

T"T  +T+-T-^T 


v^  (l  -  p)  +  w^  (1  +  p) 


Since  the  Jacobian  of  this  transformation  is  unity,  dZ^^dZg  equals  dvdw. 

Now  (l  -  p)(l  +  p)  ®  1  - 

Thus: 


^^xy 


°x°y 


2rt\Jl 


r  rv2-w2 

1 

/  /  — 5 —  ^  ' 

"  5 

LJ-m 

v^  (l  -  p) 

(1  -  p)(l  +  p) 


.  w^  (1  +  p) 

^  (1  -  pKi  T  p) 


?  dvdw 


C-2 


xy 


1 

5 


w 


dv  dw 


"-"plJVTT^Vw 


■HJ 

-CflB 


+«6/-+«i 

v2 


exp  J  -  5 


1  v‘ 


v2 


2  1  +  p^l-p 


dv  dw 


1  dv 

I  Vi  +  p 


vr 


The  first  integral  can  he  written: 


n+* 


or: 


dv  dw 


Vi  +  pVi “  P 


Now: 


dv 


t 


■+• 

v2 


exp 


rfil) 


dv  is  of  the  form  /  x  exp 


I  x^  exp  I  -  cx^Jdx 

-/»aa 


which  is 


2=0  V^) 


'  "  a  (n^  p) 


Thus  the  first  integral  hecomes: 


C-3 


*  ir  1  ’  1 


dw 


The  latter  expression  is  of  the  form; 
-+• 

I  exp 


^xp  I  -  c^^|dx 


v; 

sr 


with; 


2  (1  -  p) 


and: 


Vs  Vw 

Therefore,  integration  of  the  first  integral  yields: 


1  +  p  1  1 

Vi  -  P  Vi  Va 

Using  similar  methods  on  the  second  Integral  yield.  -(l  -  p)  as  the 
result. 

Therefore ; 


.  ^VIVT 


1  +  p 


xy 


^  (1  *  p)  -  (1  -  p) 


or: 


^Axy  “  P°x°y 
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